MODEL FOR PERSON PSYCHOEMOTIONAL STATE DETERMINATION USING AUDIO AND VIDEO DATA

نویسندگان

چکیده

Determination of the person’s psychoemotional state finds application in a variety tasks from diagnosis diseases to prevention emergency traffic situations. Given importance and where it used, there are many methods approaches exists, but most them use only one nonverbal feature, such as person's voice or facial expressions. At same time, simultaneous several signs can increase accuracy compared using sign. In this paper, method has been developed that uses expression signs. Based on literature review analysis existing methods, best were selected, was with solutions. The made possible improve CMCNN, at each test, Accuracy its own less comparison DisVoice + SVM. For improving weighted average proposed instead usual more complex model, which is able detect interrelation between expression.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Person Tracking Using Audio-Video Sensor Fusion

Motivation: Audio and video signals originating from the same source tend to be related. To achieve optimal performance, a tracking system must exploit not just the statistics of each modality alone, but also relationships between the two. Consider a system that tracks moving objects. Such a system may use video data to track the spatial location of an object. If an object emits sound, such a s...

متن کامل

A Data Model for Audio-Video Data

Audio and video data have become critical components of information systems and these systems need to e ciently manage the large storage requirements of this type of data. However, there are no formal data models for audio video data. In this paper, we present an algebraic formalism which attempts to provide the underpinnings for the design and implementation of systems which organize and query...

متن کامل

Multimodal Person Recognition using Unconstrained Audio and Video

We propose a person identi cation technique that can recognize and verify people from unconstrained video and audio. We do not expect fully frontal face image or clean speech as our input. Our recognition algorithm can detect and compensate for pose variation and changes in the auditory background and also select the most reliable video frame and audio clip to use for recognition. We also use 3...

متن کامل

Robust Audio-Visual Person Verification Using Web-Camera Video

This thesis examines the challenge of robust audio-visual person verification using data recorded in multiple environments with various lighting conditions, irregular visual backgrounds, and diverse background noise. Audio-visual person verification could prove to be very useful in both physical and logical access control security applications, but only if it can perform well in a variety of en...

متن کامل

Parameter and State Estimation using Audio and Video Signals

The complexity of industrial systems and the mathematical models to describe them increases. In many cases point sensors are no longer sufficient to provide controllers and monitoring instruments with the information necessary for operation. The need for other types of information, such as audio and video, has grown. Suitable applications range in a broad spectrum from microelectromechanical sy...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Nau?nyj rezul?tat

سال: 2022

ISSN: ['2518-1092']

DOI: https://doi.org/10.18413/2518-1092-2022-7-3-0-5